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DETAILED ACTION 

Response to Arguments 

1 . Applicant's arguments with respect to claims 22 and 33 have been considered 
but are moot in view of the new ground(s) of rejection. 

Applicant argues that Agarawal does not teach newly added limitations requiring 
requesting a specific access point from a remote unit and searching for the specific 
random access point at the server. The examiner agrees; 

However, previously cited prior art to Lin teaches a user selecting a specific frame for 
random access (see col. 7 II. 65- col. 8 II. 6, where a client requests random access and 
the server determines the type of the requested frame). The requested frame qualifies 
as a specific random access point. Furthermore, the specific access point (frame) is 
input by a user at a remote unit (client) (see fig. 2 and col. 3 II. 58-62, where a user 
inputs a request for a VCR function, including random access, to a client that is remote 
from the server). 

Claim Objections 

2. Claim22 objected to because of the following informalities: 

Claim 22 line 5 claims, "the user", however there is no antecedent basis for a 

user. 

Appropriate correction is required. 
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Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

4. Claims 22-29 are rejected under 35 U.S.C. 1 03(a) as being unpatentable over 
Lin et al (US 6,738,980) in view of Wee et al (US 6,1 04,441 ), and in further view of Aksu 
et al (WO 03/028293). 

Claim 22: 

Lin discloses a Hypertext Transfer Protocol (HTTP) based (see. col. 3 II. 
53) where the streaming is done over the internet, which uses HTTP) video 
streaming method, comprising: 

receiving, by a transmitting server (server 101), information of a specific random 
access point (see col. 7 II. 65- col. 8 II. 6, where a client requests random access 
and the server determines the type of the requested frame. The specific 
random access point is a frame) from a remote unit (see fig. 4 steps 400 and 
414; fig. 2 client 102 is remote from server 101), the specific random access 
point being input by the user (see user in fig. 2) at the remote unit; 
searching for the specific random access point in a content file stored in the 
transmitting server (col. 7 II. 65-col. 8 II. 1 1 teaches reading out frames until the 
requested frame is read out) in response to the transmitting server receiving the 
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information of the specific random access point input by the user at the remote 
unit (col. 7 II. 66-col. 8 II. 2 teach that the above step is done in response to a 
client requesting random access play); 

Lin also discloses that if a random access point selected by the user is an 
I frame, the starting point of the stream is that I frame (see col. 2 II. 19-22). 
however, if the random access point selected is a P-frame, the system must 
adjust the starting point of the stream to the most recent I frame and transmit the 
most recent I frame with all the p frames leading to the requested random access 
p frame (see col. 4 II. 24-32) The coincidence between the random access point 
and a data transmission starting point is that if the requested random access 
point is an I frame, the data transmission starting point is that I frame, however if 
the random access point is a p frame, then the data transmission starting point 
will be the closest l-frame. Although Lin does not explicitly teach determining the 
existing l-frame that is most similar, one of ordinary skill in the art would 
recognize that the l-frame closest in proximity is generally the l-frame that is most 
similar. The closest l-frame would be the l-frame that the P-frame is dependant 
upon. The fact that the target P-frame is dependent upon that l-frame, as 
opposed to other l-frames, implies the closest l-frame is the most similar because 
it has the strongest dependency. The disclosure by Lin reads on "reconfiguring a 
data stream according to a screen type (frame type) of the random access point 
and a coincidence between the random access point and a data transmission 
starting point" and "determining an existing l-frame most similar to the random 
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access point when the random access point is determined to be a P-frame and is 
the data transmission starting point" (by determining the l-frame the random 
access point is dependant upon). 

Lin also discloses that when either the random access I frame or the 
closest I frame is sent (depending on the screen type of the random access point 
chosen by the user), the rest of the frames in the stream are sent as well (see 
Fig. 6B, where a random access point 22 in the forward stream was chosen. 
Frame 22 in the forward stream is a p- frame. The closest I frame was searched 
and found to be I frame 21 in the reverse stream. I frame 21 and the rest of the 
following frames (frames 22, 23, 24, etc... ) in the forward stream were sent to 
the user), this disclosure by Lin reads on "configuring the new data stream using 
the media data sample and the continuous data samples", where the media data 
sample is the closest I frame, I frame 21 in the reverse stream, and the 
continuous data samples are the rest of the frames in the forward stream. Had 
only the forward stream been available at the server, the closest I frame, I frame 
14 in the forward stream and the rest of the frames leading to frame 22 would 
have been sent along with the rest of the frames following random access frame 
22 in the content file. This new stream is transmitted to the user (see supporting 
text col. 8 II. 59- col. 9 II. 15). 

Lin does not disclose "configuring the media data sample having the new 
l-frame as the data transmission starting point" and "converting the P-frame into 
a new l-frame by calculating values of the existing l-frame and a next P-frame, 
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repeatedly performing the converting until the next P-frame is the random access 
point to convert the P-frame random access point into a final new I- frame" or 
"changing a first header information of the new data stream". 

Wee teaches a method of manipulating and editing a temporal order of an 
image (manipulating the play order of at least one image frame relative to 
another, see col. 6 II. 8-15). Randomly accessing points in a video qualifies as 
such because the user is accessing images in a different order than they would 
otherwise be played. If the target frame (see col. 1 1 II. 35-54; in this case, the 
target frame is P7) is not an l-frame, the routine follows the dependencies until it 
determines the closest l-frame (11) which the target frame either directly or 
indirectly (i.e. frame P7 depends on frame P4, which depends on frame 11) 
depends on. The routine converts any P-frames in the line of dependency to I- 
frames until the target frame is ultimately converted to an l-frame ("For example, 
if a frame P7 which is to be transcoded is discovered to depend on frame P4 
which in turn depends on frame 11, a nested transcoding subroutine is then called 
using frame P4 as the current frame and frame 11 as the reference frame, to 
convert frame P4 to independent frame 14. This process, indicated by a function 
block 251 of FIG. 6, is performed in as many nested loops as necessary to yield 
an I frame as reference frame for use with the P frame 241 . In the hypothetical 
involving frames P7, P4 and 11, a dominant subroutine of the editor uses frame 
P7 as the current frame and frame 14 as the anchor frame, to yield frame 17."). 
Wee's frame conversion does occur until the target frame (P7) is converted into 
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an l-frame (17). It would have been obvious to one of ordinary skill in the art at 
the time the invention was made to modify the method of "receiving a random 
access request from a remote unit by a transmitting server; searching a random 
access point in a content file stored in the transmitting server in response to the 
transmitting server receiving the random access request; reconfiguring a data 
stream according to a screen type (frame type) of the random access point and a 
coincidence between the random access point and a data transmission starting 
point", "searching an existing l-frame closest to the random access point when 
the random access point is determined to be a P-frame and is the data 
transmission starting point", and "configuring the media data sample having an I- 
frame as the data transmission starting point" of Lin with the method of 
"converting the P-frame into a new l-frame by calculating values of the existing I- 
frame and a next P-frame, performing the converting until the next P-frame is the 
random access point to convert the P-frame random access point into a final new 
I- frame" of Wee for the benefit of gaining access to individual frames in fast- 
forward, rewind, editing, or splicing operations, thereby enhancing the viewers 
experience. 

Further, the combined teachings of Lin and Wee suggest "configuring a 
media data sample having the new l-frame as the data transmission starting 
point". Lin teaches transmitting a reference frame with the least cost when 
random access is requested (col. 8 II. 2-6). Costs can be calculated based on 
"distances from the possible reference frames to the next requested frame" 
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and/or "the numbers of bits required for decoding the next requested frame" (the 
sum of the bit-rates of those frames to be transmitted) (col. 6 II. 23-30). When 
combined with Wee's teaching of converting P-frames and B-frames into l-frames 
(col. 11 II. 35-54 and col. 12 II. 8-24), all of which can be done prior to 
transmission to the receiving unit (see fig. 3), the frame with the least cost would 
be a converted l-frame. Therefore, Lin's in view of Wee teaches transmitting the 
newly created l-frame (configuring a media data sample having the new l-frame 
as the data transmission starting point). Lin also teaches continuing with 
forward-play after accessing the requested random access frames (col. 7 II. 65- 
col. 8 II. 18) (configuring a new data stream using the media data sample and 
continuous media data samples). 

Neither Lin nor Wee disclose "changing a first header information of the 
new data stream" and "transmitting the new data stream including the first header 
information from the transmitting server to the remote unit. 

Aksu, an inventor from the same or a similar field teaches an MP4 meta- 
data including sample type and size. He stresses that media decoding and 
playback are typically not possible without this metadata/header information. In 
the case where a frame format is changed, this information must change; For 
example, the size of an l-frame is larger than that of a P-frame or B-frame, and 
therefore the size field would change. This "sample-specific meta-data" appears 
at the beginning of a file (i.e. as a header) (pg. 8 II. 1 9-32). The header is 
transmitted along with the stream. Specifically, Aksu teaches including the 
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contents of a 'moov' atom (i.e. representative header) at the beginning of a file. It 
would have been obvious to one of ordinary skill in the at the time the invention 
was made to modify the method of "receiving a random access request from a 
remote unit by a transmitting server; searching a random access point in a 
content file stored in the transmitting server in response to the transmitting server 
receiving the random access request", "reconfiguring a data stream according to 
a screen type (frame type) of the random access point and a coincidence 
between the random access point and a data transmission starting point", 
"searching an existing l-frame closest to the random access point when the 
random access point is determined to be a P-frame and is the data transmission 
starting point", "converting the P-frame into a new l-frame by calculating values 
of the existing l-frame and a next P-frame, repeatedly performing the converting 
until the next P-frame is the random access point to convert the P-frame random 
access point into a final new l-frame", "configuring the media data sample having 
the final new l-frame as the data transmission starting point", "configuring the 
new data stream using the media data sample and the continuous data 
samples", and "transmitting the new data stream to the remote unit" of Lin, and 
Wee with the method of " converting a header of the media data sample into a 
representative header " of Aksu because the fragmentation of a movie file 
shortens the length of time that a user has to wait before starting to view the 
streamed media as opposed to a non fragmented MP4 file (see Aksu p. 3 11.11- 
22 and p.4 11.18-34). 
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Claim 23: 

Lin and Wee disclose the method of claim 22 as discussed previously. Lin 
discloses that the streaming media file consists of an MPEG file. 
However, neither Lin nor Wee disclose "an MF4 file applied by a file 
fragmentation process, and the data stream includes a plurality of media data 
samples and a plurality of headers of the respective media data samples." 

Aksu, an inventor from the same or a similar field, discloses that the mp4 
file form comprises a plurality of data segments, the representative header 
associated with a first of a plurality of data segments; and a plurality of segment 
headers, each associated with remaining ones of the plurality of data segments 
(see Fig. 5a and page 8 lines 28- 29; Aksu discloses that meta-data (moov in a 
non fragmented file or moov and moof in a fragmented mp4 file) typically appears 
at the beginning of streaming files as a file header section. Figure 5a shows a 
representative header labeled "File-level meta-data description part" which is 
only associated with a first of a plurality of data segments as shown in the figure 
and a plurality of segment headers labeled "meta data x" where x is the segment 
number). It would have been obvious to one of ordinary skill in the art at the time 
the invention was made to modify the method of streaming a content file of Lin, 
and Wee with the method "wherein the content file in the transmitting server is an 
MP4 file applied by a file fragmentation process, and the data stream includes a 
plurality of media data samples and a plurality of headers of the respective media 
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data samples" of Aksu because the fragmentation of a movie file shortens the 
length of time that a user has to wait before starting to view the streamed media 
as opposed to a non fragmented MP4 file (see Aksu p.3 11 .1 1-22 and p.4 11.18- 
34). 

Claim 24: 

Aksu discloses a representative header including common meta 
information of the respective media data samples and time information of a first 
media data sample; and at least one segment header including time information 
of the respective media data samples except the first media data sample (see 
Fig. 5a, Page 8 line 34-page 9 line 1 1 and Annex 1 ; Aksu discloses a 
representative header including common meta information of the respective 
media data samples ("file-level metadata description part") and at least one 
segment header including time information of the respective media data samples 
except the first media data sample (segment "Meta-data" x). Annex 1 provides a 
list of modified MP4 atoms (structured meta data). Time information is disclosed 
in Edit List Atom and Sample Table Atom). 

Claim 25: 

Please see the rejection of claim 22 where it is shown that Lin discloses 
that the screen type comprises one of an I frame and a P frame. 
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Claim 26: 

Lin and Wee disclose the method of claim 22 as discussed previously. 

Lin discloses "determining whether the specific random access point is an 
l-frame or a P-frame; configuring the media data sample having the specific 
random access point as the data transmission starting point when the specific 
random access point is determined to be the I- frame; configuring a new data 
stream using the media data sample and continuous media data samples" 
(please see the rejection of claim 22). 

Neither Lin nor Wee disclose converting segment header information of a 
first media data sample segment when the random access point is an l-frame. 
Aksu, an inventor from the same or a similar field teaches meta-data including 
sample type and size. In the case where a frame format is changed, this 
information must change; For example, the size of an l-frame is larger than that 
of a P-frame or B-frame, and therefore the size field would change. This "sample- 
specific meta-data" can appear at the beginning of a file (i.e. as a header) (pg. 8 
II. 1 9-32). It would have been obvious to one of ordinary skill in the at the time the 
invention was made to modify the method of ""determining whether the random 
access point is an I- frame or a P-frame; configuring the media data sample 
having the random access point as the data transmission starting point when the 
random access point is determined to be the l-frame; configuring a new data 
stream using the media data sample and continuous media data samples" of Lin 
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and Wee with the method of "converting segment header information of a first 
media data sample segment" of Aksu because the fragmentation of a movie file 
shortens the length of time that a user has to wait before starting to view the 
streamed media as opposed to a non fragmented MP4 file (see Aksu p. 3 11.11- 
22 and p.4 11.18-34). 

Claim 27: 

Please see the rejection of claim 22. Lin discloses setting an l-frame 
closest to the P- frame as the data transmission starting point, when the random 
access point is determined to be a P-frame. 

Claim 28: 

Aksu discloses MP4 file fragmentation in Fig. 5a where a File-level meta- 
data description part which appears at the beginning of streaming files as a 
header section must be received before any video is played back (see p. 5 II. 8- 
1 1 and p 5 II. 36-p. 6 11 .1). This file-level meta-data contains information that is 
common for the media data samples (see p. 5 II. 8-11). In random access play 
this file must be received in the header of the new data stream before any 
playback can begin. Therefore, the header information of the media data sample 
must be changed for proper playback. 



Claim 29: 



Application/Control Number: 10/678,068 Page 14 

Art Unit: 2423 

Lin, and Wee disclose the method of claim 22 as discussed previously. 

Lin discloses "determining an l-frame closest to the specific random 
access point when the specific random access point is determined to be a P- 
frame and the specific random access point is not set as the data transmission 
starting point (but the closest I frame is set as the data transmission starting 
point; configuring the media data sample having the (closest) I frame as the data 
transmission starting point; configuring a new data stream using the media data 
sample and continuous media data samples" (please see the rejection of claim 
22). 

Neither Lin nor Wee disclose "converting a first header information of the 
new data stream". 

Aksu, an inventor from the same or a similar field discloses MP4 file 
fragmentation in Fig. 5a where a File-level meta-data description part which 
appears at the beginning of streaming files as a header section must be received 
before any video is played back (see p. 5 II. 8-1 1 and p 5 II. 36-p. 6 11.1). This 
file-level meta-data contains information that is common for the media data 
samples (see p. 5 II. 8-11). In random access play this file must be received in 
the header of the new data stream before any playback can begin. Therefore, the 
header information of the media data sample must be changed for proper 
playback. It would have been obvious to one of ordinary skill in the at the time 
the invention was made to modify the method of "searching an l-frame closest to 
the random access point when the random access point is determined to be a P- 
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frame and the random access point is not set as the data transmission starting 
point (but the closest I frame is set as the data transmission starting point; 
configuring the media data sample having the (closest) I frame as the data 
transmission starting point; configuring a new data stream using the media data 
sample and continuous media data samples" of Lin, and Wee with the method of 
"converting header information of a first media data sample segment" of Aksu 
because the fragmentation of a movie file shortens the length of time that a user 
has to wait before starting to view the streamed media as opposed to a non 
fragmented MP4 file (see Aksu p.3 11.11-22 and p.4 11.18-34). 

10. Claims 33-34 are rejected under 35 U.S.C. 103(a) as being unpatentable over Lin in 
view of Wee in further view of Aksu. 

Claim 33: 

Lin discloses receiving information of a specific random access point that 
was input by a user (see col. 7 II. 65- col. 8 II. 6, where a client requests random 
access and the server determines the type of the requested frame. The specific 
random access point is a frame). He also discloses if a random access point 
selected by the user is an I frame, the starting point of the stream is that I frame 
(see col. 2 II. 19-22), however, if the random access point selected is a P-frame 
("determining a P-frame associated with the specific random access point input 
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by the user"), the system must adjust the starting point of the stream to the most 
recent I frame and transmit the most recent I frame with all the p frames leading 
to the requested random access p frame (see col. 4 II. 24-32) which reads on 
"determining an I- frame that is most similar to the determined P-frame" and 
configuring a media data sample by setting an l-frame as a data transmission 
starting point. 

Although Lin does not explicitly teach determining the existing l-frame that 
is most similar to the determined P-frame, one of ordinary skill in the art would 
recognize that the l-frame closest in proximity is generally the l-frame that is most 
similar. The closest l-frame would be the l-frame that the P-frame is dependant 
upon. The fact that the target P-frame is dependent upon that l-frame, as 
opposed to other l-frames, implies the closest l-frame is the most similar because 
it has the strongest dependency. Therefore, determining the most recent l-frame 
(in reference to a requested P-frame) is equivalent to determining the existing I- 
frame that is most similar to the determined P-frame 

Lin doesn't disclose "converting a next P-frame that is adjacent to the 
determined l-frame into a new l-frame by calculating using the next P-frame and 
the l-frame; and converting header information of the media data sample." 

Wee teaches a method of manipulating and editing a temporal order of an 
image (manipulating the play order of at least one image frame relative to 
another, see col. 6 II. 8-15). Randomly accessing points in a video qualifies as 
such because the user is accessing images in a different order than they would 
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otherwise be played. If the target frame (see col. 1 1 II. 35-54; in this case, the 
target frame is P7) is not an l-frame, the routine follows the dependencies until it 
determines the closest l-frame (11) which the target frame either directly or 
indirectly (i.e. frame P7 depends on frame P4, which depends on frame 11) 
depends on. The routine converts any P-frames in the line of dependency to I- 
frames until the target frame is ultimately converted to an l-frame ("For example, 
if a frame P7 which is to be transcoded is discovered to depend on frame P4 
which in turn depends on frame 11, a nested transcoding subroutine is then called 
using frame P4 as the current frame and frame 11 as the reference frame, to 
convert frame P4 to independent frame 14. This process, indicated by a function 
block 251 of FIG. 6, is performed in as many nested loops as necessary to yield 
an I frame as reference frame for use with the P frame 241 . In the hypothetical 
involving frames P7, P4 and 11 , a dominant subroutine of the editor uses frame 
P7 as the current frame and frame 14 as the anchor frame, to yield frame 17."). 
Wee's frame conversion does occur until the target frame (P7) is converted into 
an l-frame (17). It would have been obvious to one of ordinary skill in the art at 
the time the invention was made to modify the method of "receiving a random 
access request from a remote unit by a transmitting server; searching a random 
access point in a content file stored in the transmitting server in response to the 
transmitting server receiving the random access request; reconfiguring a data 
stream according to a screen type (frame type) of the random access point and a 
coincidence between the random access point and a data transmission starting 
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point", "searching an existing l-frame closest to the random access point when 
the random access point is determined to be a P-frame and is the data 
transmission starting point", and "configuring the media data sample having an I- 
frame as the data transmission starting point" of Lin with the method of 
"converting the P-frame into a new l-frame by calculating values of the existing I- 
frame and a next P-frame, performing the converting until the next P-frame is the 
random access point to convert the P-frame random access point into a final new 
I- frame" of Wee for the benefit of gaining access to individual frames in fast- 
forward, rewind, editing, or splicing operations, thereby enhancing the viewers 
experience. 

Neither Lin nor wee disclose "changing header information of the media 
data sample". 

Aksu, an inventor from the same or a similar field teaches meta-data 
including sample type and size. In the case where a frame format is changed, 
this information must change; For example, the size of an l-frame is larger than 
that of a P-frame or B-frame, and therefore the size field would change. This 
"sample-specific meta-data" can appear at the beginning of a file (i.e. as a 
header) (pg. 8 II. 19-32). The header is transmitted along with the stream. It 
would have been obvious to one of ordinary skill in the at the time the invention 
was made to modify the method of "receiving a random access request from a 
remote unit by a transmitting server; searching a random access point in a 
content file stored in the transmitting server in response to the transmitting server 
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receiving the random access request", "reconfiguring a data stream according to 
a screen type (frame type) of the random access point and a coincidence 
between the random access point and a data transmission starting point", 
"searching an existing l-frame closest to the random access point when the 
random access point is determined to be a P-frame and is the data transmission 
starting point", "converting the P-frame into a new l-frame by calculating values 
of the existing l-frame and a next P-frame, repeatedly performing the converting 
until the next P-frame is the random access point to convert the P-frame random 
access point into a final new l-frame", "configuring the media data sample having 
the final new l-frame as the data transmission starting point", "configuring the 
new data stream using the media data sample and the continuous data 
samples", and "transmitting the new data stream to the remote unit" of Lin, and 
Wee with the method of "converting a header of the media data sample" of Aksu 
because the fragmentation of a movie file shortens the length of time that a user 
has to wait before starting to view the streamed media as opposed to a non 
fragmented MP4 file (see Aksu p.3 11.11-22 and p.4 11.18-34). 

Claim 34: 

Aksu, an inventor from the same or a similar field, discloses MP4 file 
fragmentation in Fig. 5a where a File-level meta-data description part which 
appears at the beginning of streaming files as a header section must be received 
before any video is played back (see p. 5 II. 8-1 1 and p 5 II. 36-p. 6 11 .1 ). In 
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random access play this file must be received (transmitted to a user from a 
server) in the header of the new data stream before any playback can begin. 
Therefore, the header information of the media data sample must be converted 
for proper playback. 

Conclusion 

5. Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP 
§ 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 
CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to JASMINE STOKELY-COLLINS whose telephone 
number is (571) 270-3459. The examiner can normally be reached on M-F 9:30-5:30 
EST. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Andrew Koenig can be reached on (571) 272-7296. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Jasmine Stokely-Collins/ 
Examiner, Art Unit 2423 



/Andrew Y Koenig/ 

Supervisory Patent Examiner, Art Unit 2423 



